Augmented reality card activation

ABSTRACT

Systems and methods are provided for activating a card using augmented reality. The systems and methods may include capturing a real-time image of the card using a customer device, and extracting card information from the real-time image. The card information may be processed and used by a customer device or a financial provider server to activate the card. The customer device may display interactive graphics overlaid on the real-time card image to guide the customer through the activation process, and to educate the customer about the components of the card and aspects of the financial service associated with the card, such as a credit card service. The customer may interact with the overlaid graphics such as by selecting icons or portions of the card to trigger tutorials or to set preferences related to the card and/or financial service.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/337,527, filed Jun. 3, 2021, which is a continuation of U.S. patentapplication Ser. No. 16/444,027, filed Jun. 18, 2019, which is acontinuation of U.S. patent application Ser. No. 15/897,511, filed Feb.15, 2018, which is a continuation of U.S. patent application Ser. No.14/836,028, filed Aug. 26, 2015, which claims the benefit of priorityfrom U.S. Provisional Application No. 62/042,498, filed Aug. 27, 2014.The content of the foregoing applications is incorporated herein in itsentirety by reference.

BACKGROUND

Credit cards are a very popular form of payment in today's society duein large part to their ease of use and transaction speed. But even withtheir widespread use and convenience, credit card systems still sufferfrom cumbersome activation processes and inadequate customer educationabout the credit card system. When customers receive new credit cards,they must first activate or register the cards before making anypurchases. While necessary to ensure that the customers' identities areprotected, credit card activation is generally a cumbersome processrequiring the customers to follow various written instructions includedwith the card. Once the card is activated, the customer is free to usethe card, but often proceeds without knowledge of significant aspects ofthe card's usage and payment terms and/or only a general knowledge oftypical credit card systems. Thus, current activation processes posemultiple problems.

For example, the written activation instructions included with creditcards usually instruct the customer to call an activation phone numberor navigate to an activation website, where additional instructions arepresented usually requiring the customer to manually enter the cardinformation and numerous other credentials. The number of steps involvedand the need to make phone calls or open web browsers often frustratesand discourages customers from activating and using their cards rightaway.

As another example of their shortcomings, current credit card activationsystems allow customers to begin making purchases immediately upon phoneor web activation without providing any educational information abouttheir credit account. As noted above, many uninformed customers are newto credit cards, but even experienced cardholders do not knowsignificant aspects of credit such as the card features, interest rates,penalties, and how to manage their new credit account. Without learningthis information quickly, customers may find themselves in financialtrouble from misuse of their credit account.

Moreover, many customers rarely take advantage of the full range ofbenefits that accompany their credit cards. Some card issuing financialservice providers offer one or more companion applications to complementthe credit card and enhance the customer's experience. However, afterreceiving and activating their credit cards, many customers neverdownload the application or link their credit card to enjoy the addedbenefits.

In view of the shortcomings of current systems, a convenient,interactive and informative card activation system is desired.

SUMMARY

Disclosed embodiments provide methods and systems for activating a cardand providing information about the card using augmented reality.

Consistent with a disclosed embodiment, an augmented-reality accounttransaction card activation method is provided. The method may includecapturing, by a video camera, a real-time image of an inactive accountcard, processing, by a processor in communication with the video camera,the captured real-time image to obtain card information presented on theaccount card; verifying an identity of an individual associated with theaccount card, displaying, on a display in communication with theprocessor, card activation queries overlaid on the real-time image,receiving, by an I/O device in communication with the processor, cardactivation data comprising responses to the displayed activationqueries, identifying, by the processor, one or more card terms based onthe obtained card information, displaying, on the display incommunication with the processor, the one or more card terms overlaid onthe real-time image, and indicating that the account card is activatedbased on the verification and received activation data.

Consistent with another disclosed embodiment, a real-time augmentedreality account card activation system is provided. The system mayinclude a memory device having instructions stored thereon, and one ormore processors in communication with the memory device. The one or moreprocessors may be configured to execute the stored instructions tocapture a real-time image of an inactive account card, process thecaptured real-time image to obtain card information presented on thecard, verify an identity of an individual associated with the accountcard, display card activation queries overlaid on the real-time image,receive card activation data comprising responses to the displayedactivation queries, identify one or more card terms based on theobtained card information, display the one or more card terms overlaidon the real-time image, and indicate that the account card is activatedbased on the verification and received activation data.

Consistent with other disclosed embodiments, non-transitorycomputer-readable storage media may store program instructions, whichare executed by at least one processor device and perform any of themethods described herein.

The foregoing general description and the following detailed descriptionare exemplary and explanatory only and are not restrictive of theclaims.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate several embodiments and, togetherwith the description, serve to explain the disclosed principles. In thedrawings:

FIG. 1 is a diagram of an exemplary system that may be used to activatea card and provide card information, consistent with disclosedembodiments.

FIG. 2 is a diagram of an exemplary customer device, consistent withdisclosed embodiments.

FIG. 3 is a diagram of an exemplary financial service provider server,consistent with disclosed embodiments.

FIG. 4 is a flowchart of an exemplary augmented reality card activationprocess, consistent with disclosed embodiments.

FIG. 5 is a flowchart of an exemplary tutorial and preferences setupprocess, consistent with disclosed embodiments.

FIGS. 6A-6B are illustrations of portions of an exemplary augmentedreality card activation process, consistent with disclosed embodiments.

DETAILED DESCRIPTION

The disclosed embodiments are directed to systems and methods foractivating new financial services cards, as well as learning about thecards and the credit card system, using augmented reality. In someembodiments, “augmented reality” means a live view of real-worldelements, modified using computer processing such as computer generatedgraphics. The live view may include an image captured by a camera thatis displayed in real-time on a display. The real-time image may beaugmented by simultaneously overlaying computer-generated graphicsincluding text, images, or video on the real-time image. The overlaidgraphics may be generated in real-time based in part on the processedreal-time image.

According to some embodiments, a customer may activate a new accountcard using their customer device running a computer-executable softwareapplication (“app”) provided by an organization that issued the accountcard, such as a financial service provider (“FSP”). The account card maybe a credit card, debit card, or other card or physical device used toconduct electronic account transactions associated with functions oractivities of the FSP. In some embodiments, the “card” may be a check ornear field communication (NFC) payment device. For purposes ofexplanation, this discussion will focus on credit cards. The FSP may bea bank, credit card company, or other entity associated with financialtransactions. The mobile application may be a standalone softwareapplication for a personal computing device, such as personal computersoftware or a mobile device app, or part of another software applicationprovided by the FSP for managing finances related to banking, checking,credit cards, and/or debit cards. It should be understood, however, thatdisclosed embodiments are not limited to any particular industry orfield and, in fact, may be implemented by any entity associated withuser registration, account activation, or the like. For example, in someembodiments, the account card may be a membership card or identificationcard issued by an organization such as a government agency, club,merchant, or any other organization that issues account cards specificto individual persons associated with the organization. Thus, thedisclosed embodiments have uses other than in the financial servicesindustry, as the type of transaction or nature of the organization thatissues the card is merely tangential to the novelty of the disclosedembodiments. The disclosed embodiments provide advancements in thesystems and methods for activating new account accounts usingtechnological solutions involving specially-programmed devices andcertain types of hardware, as disclosed herein.

In some embodiments, to activate a new card, the customer may launch anFSP app and capture an image of the new card using the camera on theircustomer device. The FSP app may then recognize the card, verify thecard information with the financial service provider, and provide animmersive, interactive augmented reality set-up and/or educationexperience to explain the card and/or account features and allow thecustomer to adjust settings related to the card or the financialservices associated with the card.

By implementing augmented reality, the systems and methods disclosedherein provide, among other things, an engaging product set-upexperience that can help customers use their financial services wiselyand efficiently from the start. As a further advantage, the augmentedreality card activation systems and methods disclosed herein mayfacilitate the often cumbersome process of linking the card to the FSPapp, which may provide features and incentives for the financial serviceassociated with the card, enhancing the customer's experience.

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings and disclosedherein. Wherever convenient, the same reference numbers will be usedthroughout the drawings to refer to the same or like parts.

FIG. 1 shows a diagram of an exemplary augmented reality card activationsystem 100 that may be configured to perform one or more softwareprocesses that, when executed by one or more processors, activate newcards and provide an augmented reality tutorial and preferences setupexperience, consistent with disclosed embodiments. The components andarrangements shown in FIG. 1 are not intended to limit the disclosedembodiments, as the components used to implement the disclosed processesand features may vary.

In accordance with disclosed embodiments, augmented reality cardactivation system 100 may include a customer device 110 associated witha customer 120, an account card 130, a financial service provider(“FSP”) 150, and a FSP server 152. Customer device 110 may communicatewith FSP server 152 directly or via network 140. Other components knownto one of ordinary skill in the art may be included in system 100 togather, process, transmit, receive, and provide information used inconjunction with the disclosed embodiments.

Customer 120 may be a customer of the financial service provider 150,such as an individual who holds a credit card, debit card, checking,and/or savings account with FSP 150. Customer 120 may operate customerdevice 110 to activate account card 130 and/or learn about account card130, financial account terms associated with the card, etc. using theaugmented card activation processes disclosed herein.

Customer device 110 may be a personal computing device such as, forexample, a mobile device with computing ability, a tablet, smartphone,wearable device such as Google Glass™ or smart watches, a generalpurpose or notebook computer, or any combination of these computersand/or affiliated components. In one embodiment, customer device 110 maybe a computer system or mobile computer device that is operated bycustomer 120 who is a customer of FSP 150.

FSP server 152 may be operated by FSP 150. FSP 150 may be an entity thatprovides financial services to customers, such as a bank, credit cardcompany, merchant, lender, and the like. FSP server 152 may be acomputer-based system including computer system components, desktopcomputers, workstations, tablets, hand held computing devices, memorydevices, and/or internal network(s) connecting the components.

Network 140 may comprise any type of computer networking arrangementused to exchange data. For example, network 140 may be the Internet, aprivate data network, virtual private network using a public network,and/or other suitable connection(s) that enables system 100 to send andreceive information between the components of system 100. Network 140may also include a public switched telephone network (“PSTN”) and/or awireless network such as a cellular network, WiFi network, or otherknown wireless network capable of bidirectional data transmission.

FIG. 2 shows a diagram of an exemplary customer device 110, consistentwith disclosed embodiments. As shown, customer device 110 may include adisplay 210, input/output (“I/O”) devices 220, one or more processors230, memory 240 having stored thereon one or more programs 250, such asFSP app 252, and also storing data 260, and may further include anantenna 270 and one or more camera 280.

I/O devices 220 may include one or more devices that customer device 110to receive input from customer 120 and provide feedback to customer 120.I/O devices 220 may include, for example, one or more buttons, switches,speakers, microphones, or touchscreen panels. In some embodiments, I/Odevices 220 may be manipulated by customer 120 to input information intocustomer device 110.

Processor 230 may be one or more known processing devices, such as amicroprocessor from the Pentium™ family manufactured by Intel™ or theTurion™ family manufactured by AMD™ Processor 230 may constitute asingle core or multiple core processors that executes parallel processessimultaneously. For example, processor 230 may be a single coreprocessor configured with virtual processing technologies. In certainembodiments, processor 230 may use logical processors to simultaneouslyexecute and control multiple processes. Processor 230 may implementvirtual machine technologies, or other known technologies to provide theability to execute, control, run, manipulate, store, etc. multiplesoftware processes, applications, programs, etc. In another embodiment,processor 230 may include a multiple-core processor arrangement (e.g.,dual, quad core, etc.) configured to provide parallel processingfunctionalities to allow customer device 110 to execute multipleprocesses simultaneously. One of ordinary skill in the art wouldunderstand that other types of processor arrangements could beimplemented that provide for the capabilities disclosed herein.

Memory 240 may be a volatile or non-volatile, magnetic, semiconductor,tape, optical, removable, non-removable, or other type of storage deviceor tangible (i.e., non-transitory) computer-readable medium that storesone or more program(s) 250 such as FSP app 252, and data 260. Data 260may include, for example, customer 120's personal information, accountinformation, and display settings and preferences.

Program(s) 250 may include operating systems (not shown) that performknown operating system functions when executed by one or moreprocessors. By way of example, the operating systems may includeMicrosoft Windows™, Unix™, Linux™, Apple™ operating systems, PersonalDigital Assistant (PDA) type operating systems, such as Microsoft CE™,or other types of operating systems. Accordingly, disclosed embodimentsmay operate and function with computer systems running any type ofoperating system. Customer device 110 may also include communicationsoftware that, when executed by a processor, provides communicationswith network 140, such as Web browser software, tablet, or smart handheld device networking software, etc. Customer device 110 may be adevice that executes mobile applications for performing operationsconsistent with disclosed embodiments, such as a tablet or mobiledevice.

Program(s) 250 may also include FSP app(s) 252, such as an augmentedreality card activation app, which when executed causes customer device110 to perform processes related to card activation such as: activatingand setting up a new account card 130, controlling camera 280 to capturereal-time image data of account card 130, controlling processor toprocess the real-time image, establish bidirectional communication withFSP server 152, send card information and customer 110 credentials toFSP server 152, receive authentication and activation information fromFSP server 152, generate augmented reality graphics, and displayaugmented reality graphics simultaneously with a real-time image ofaccount card 130. In some embodiments, FSP app(s) 252 may include amobile banking app associated with providing, managing, and/ormaintaining financial service accounts including, for example, checkingbalances, paying bills, performing financial transactions, receivingmarketing messages, etc.

FIG. 3 shows a diagram of an exemplary FSP server 152, consistent withdisclosed embodiments. As shown, FSP server 152 may include one or moreprocessor 320, input/output (“I/O”) devices 330, memory 340 storingprograms 350 including, for example, server app(s) 352, operating system354, and storing data 360, and a database 370. FSP server 152 may be asingle server or may be configured as a distributed computer systemincluding multiple servers or computers that interoperate to perform oneor more of the processes and functionalities associated with thedisclosed embodiments.

Processor 320 may be one or more known processing devices, such as thosedescribed with respect to processor 230 in FIG. 2 .

FSP server 152 may also include one or more I/O devices 330 that maycomprise one or more interfaces for receiving signals or input fromdevices and providing signals or output to one or more devices thatallow data to be received and/or transmitted by FSP server 152. Forexample, FSP server 152 may include interface components, which mayprovide interfaces to one or more input devices, such as one or morekeyboards, mouse devices, and the like, that enable FSP server 152 toreceive input from an employee of the financial service provider (notshown).

FSP server 152 may include one or more storage devices configured tostore information used by processor 320 (or other components) to performcertain functions related to the disclosed embodiments. In one example,FSP server 152 may include memory 340 that includes instructions toenable processor 320 to execute one or more applications, such as serverapplications, a customer and card authentication application, a cardactivation authentication, an electronic transaction application,network communication processes, and any other type of application orsoftware known to be available on computer systems. Alternatively oradditionally, the instructions, application programs, etc. may be storedin an internal database 370 or external storage in direct communicationwith FSP server 152 (not shown), such as one or more database or memoryaccessible over network 140. Database 370 or other external storage maybe a volatile or non-volatile, magnetic, semiconductor, tape, optical,removable, non-removable, or other type of storage device or tangible(i.e., non-transitory) computer-readable medium.

In one embodiment, FSP server 152 may include memory 340 that includesinstructions that, when executed by processor 320, perform one or moreprocesses consistent with the functionalities disclosed herein. Methods,systems, and articles of manufacture consistent with disclosedembodiments are not limited to separate programs or computers configuredto perform dedicated tasks. For example, FSP server 152 may includememory 340 that may include one or more programs 350 to perform one ormore functions of the disclosed embodiments. Moreover, processor 320 mayexecute one or more programs located remotely from account informationdisplay system 100. For example, FSP server 152 may access one or moreremote programs, that, when executed, perform functions related todisclosed embodiments.

Programs 350 stored in memory 340 and executed by processor(s) 320 mayinclude one or more server app(s) 352 and operating system 354. Serverapp(s) 352 may incorporate one or more financial services account appsthat cause processor(s) 320 to execute one or more processes related tofinancial services accounts associated with one or more customersincluding, but not limited to, storing customer and account information,storing card information, processing card activation requests,authenticating customers and cards, storing card term information, andtransmitting card activation results and card term information.

Memory 340 and database 370 may include one or more memory devices thatstore data and instructions used to perform one or more features of thedisclosed embodiments. Memory 340 and database 370 may also include anycombination of one or more databases controlled by memory controllerdevices (e.g., server(s), etc.) or software, such as document managementsystems, Microsoft SQL databases, SharePoint databases, Oracle™databases, Sybase™ databases, or other relational databases.

FSP server 152 may also be communicatively connected to one or moreremote memory devices (e.g., remote databases (not shown)) throughnetwork 140 or a different network. The remote memory devices may beconfigured to store information and may be accessed and/or managed byFSP server 152. By way of example, the remote memory devices may bedocument management systems, Microsoft SQL database, SharePointdatabases, Oracle™ databases, Sybase™ databases, or other relationaldatabases. Systems and methods consistent with disclosed embodiments,however, are not limited to separate databases or even to the use of adatabase.

FIG. 4 shows a flowchart of an augmented reality activation process 400.Augmented reality activation process 400 may begin in step 402, whencustomer device 110 launches FSP app 252 based on, for example, inputreceived from customer 120. If FSP app 252 is not currently installed oncustomer device 110, such as when customer 120 is a new customer of FSP150, customer device 110 may first download and install FSP app 252(steps not shown). Customer device 110 may install FSP app 252 upon, forexample, customer 120 operating the customer device 110 to navigate to awebsite, access an applications store/repository, or scanning a code(included, for example, with account card 130), such as a quick response(QR) code or a barcode, to automate the download and installationprocess.

After FSP app 252 launches, in step 404, customer device 110 may receiveaccount login information associated with customer 120. Customer device110 may prompt customer 120 to create a new account (for example, whenFSP app 252 was just installed), to identify customer 120 to FSP 150.FSP app 252 may prompt customer 120 to enter one or more credentials tologin to their account such as, for example, a name, username, password,birthdate, PIN number, etc.

In step 406, FSP app 252 may access one or more camera 280 in customerdevice 110. Customer device 110 may then prompt customer 120 to place aninactive account card 130 within view of camera 280 and capture an image(step not shown). Camera 280 may begin capturing a real-time image (step408), and provide the real-time image, such as a continuous live videofeed, to processor 220 for analysis based on the needs of FSP app 252.

In some embodiments, FSP app 252 may cause processor 220 to continuouslyanalyze the real-time image data received from camera 280, to detect theinactive account card 130 in the image frame (step 410). In someembodiments, processor 220 may detect account card 130 by recognizingthe shape and outline of the card within the real-time image. Ifprocessor 220 is unable to detect account card 130 after a predeterminedtime period, customer device 110 may prompt customer 120 to repositionaccount card 130 in front of camera 280 (step not shown).

In step 412, processor 220 may extract card information from thedetected account card 130. In some embodiments, processor may employ oneor more known character recognition algorithms to recognize characterssuch as letters, numbers, and symbols printed on the card.

In step 414, processor 220 may process the extracted card information.In some embodiments, processor 220 may parse the recognized charactersinto pieces of card information such as, for example, an account number,cardholder name, expiration date, security code, financial serviceprovider name, card product (e.g. “Platinum,” “Gold,” etc.), and otherpieces of card information based on FSP 150's needs. Processor 220 maycause the processed card information to be stored for later use by FSPapp 252 and/or FSP server 152 (step not shown). In some embodiments, FSPserver 152 may perform some or all of the card information processing.In such embodiments, customer device 110 may transmit unprocessedextracted card information to FSP server 152 via network 140.

In step 416, system 100 may authenticate customer 120 and account card130. In some embodiments, authentication is performed at FSP server 152by processor 320, based on the processed account card 130 informationand the one or more customer 120 credentials transmitted from customerdevice 110 (step not shown). FSP server 152 may compare the processedaccount card 130 information and customer 120 credentials to one or moreentries stored in database 370, to determine whether account card 130 isauthentic and/or whether customer 120's identity is verified. Step 416may incorporate one or more authentication processes for customer 120and account card 130 known to those of ordinary skill in the art. Insome embodiments, customer device 110 (via, e.g., processor 230) mayperform some or all of the authentication steps based on the processedaccount card 130 information, customer 120 credentials, and based ondata received from FSP server 152.

In step 418, FSP server 152 may activate account card 130. In someembodiments, activation may comprise updating database 370 to indicatethat account card 130 is authorized to perform transactions for customer120's account. FSP server 152 may transmit an indication to customerdevice 110 confirming that account card 130 is activated and ready touse for conducting financial transactions. In some embodiments, customerdevice 110 may display the activation confirmation to customer 120immediately (step not shown). In other embodiments, customer device 110may receive and store the activation confirmation until process 400 iscomplete.

In step 420, customer device 110 may launch a tutorial and preferencessetup process, described in further detail with respect to FIG. 5 .During tutorial and preferences setup process 420, customer device 110may generate and display augmented reality graphics to educate customer120 about the features of their card, card terms, and the financialservice associated with the card. Customer device 110 may also generateaugmented reality graphics related to one or more preferences, such asnotification settings, spending goals, etc. Additionally, customerdevice 110 may generate and display augmented reality graphics relatedto associating account card 130 to FSP app 252 and/or customer device110 to provide customer 120 with an enhanced features, such as accountmonitoring and managing through customer device 110.

Once tutorial and preferences setup process 420 completes, process 400ends and customer device 110 may provide an indication to customer 120that account card 130 is activated and ready for use in step 422. Forexample, customer device 110 (via, e.g., display 210) may display amessage confirming activation of account card 130. In some embodiments,the account card 130 activation indication may be provided earlier inprocess 400, such as between steps 418 and 420.

FIG. 5 shows an exemplary flowchart of a tutorial and preferences setup,such as step process 420 from FIG. 4 . In some embodiments, tutorial andpreferences setup process 420 may occur after step 418 from FIG. 4 .Process 420 may begin in step 502 when camera 280 captures a real-timeimage of account card 130, thereby capturing card image 132 (itemillustrated in FIG. 6 ). In some embodiments, step 502 may be acontinuation of step 408, where camera 280 continuously capturesreal-time image data throughout process 400. In other embodiments, step502 may comprise a new image capture step when image capture step 408previously ceased.

In step 504, processor 230 may process the real-time image includingcard image 132 to extract information necessary for tutorial andpreferences setup process 420. In some embodiments, processor 230 maydetect account card 130's position and orientation in the real-timeimage in step 506. For example, processor 230 may scan the real-timeimage to detect an object having the approximate shape and dimensions ofa credit card, or another pre-programmed shape. Processor 230 may alsodetect the orientation of account card 130, such as by identifying textor patterns on account card 130 indicative of account card 130'sorientation. In step 508, processor 230 may detect card content to beused in tutorial and preferences setup process 420. Similar to step 412,processor 230 may extract card information such as a card number,cardholder name, security code, bank name, product name/type, and anyother text, numbers, and symbols on account card 130. Regarding step508, in some embodiments, processor 230 may also identify one or morepositions of the pieces of card information in card image 132. The cardinformation positions may be used to position augmented reality graphicson display 210 relative to the card information positions in card image132. Processor 230 may continuously detect card content to updatedetected card information and card information positions if, forexample, customer 120 moves account card 130 during process 420, such asby rotating account card 130 or flipping account card 130 to the reverseside.

In step 510, system 100 may identify one or more terms associated withthe financial account of account card 130. In some embodiments, customerdevice 110 may transmit the extracted and detected card information toFSP server 152, and FSP server 152 may send one or more account termsback to customer device 110. FSP server 152 may query database 370 foraccount terms associated with one or more pieces of card information,such as an annual percentage rate (APR) associated with an extractedaccount card 130 number, cardholder name, card product/type, etc. Cardterms may include, for example, a credit limit, billing cycle dates orlength, APR, payment due date, annual fee, grace period, minimum paymentamount, over-the-limit fee, variable interest rate, late fee amounts,and any other terms set by FSP 150 and associated with account card 130.FSP server 152 may then transmit the identify card terms to customerdevice 110 for use during the augmented reality tutorial and preferencessetup. In some embodiments, customer device 110 may identify accountcard 130 terms without querying FSP server 152. For example, customerdevice 110 may have a database of card terms stored in memory 240, andprocessor 230 may compare the detected card content to stored card termsto identify terms for account card 130.

In step 512, processor 230 may generate augmented reality (AR) graphicsfor display over card image 132. Augmented reality graphics may includetext, images, and/or video for explaining the determined account card130 terms, or for educating customer 110 about the financial servicesassociated with account card 130, such as how credit card systems work.Generated AR graphics may vary based on the determined card position andorientation, so that the AR graphics, when displayed, will appear to“interact” with card image 132 by resizing, relocating, rotating, orchanging content based on the detected card position/orientation and thedetected card content.

In some embodiments, FSP server may generate some or all AR graphics,and transmit the generated AR graphics to customer device 120 fordisplay on display 210.

In step 514, display 210 may display the captured real time imageincluding card image 132, and overlay the real-time image with thegenerated AR graphics. The AR graphics and real-time image may bedisplayed in real-time, e.g., as the image is being captured by camera280. Depending on the processing speeds and capabilities of processor230 and/or FSP server 152, step 514 may occur at a minor time lag behindstep 502. Regardless, step 514 may be performed in substantiallyreal-time, e.g. within seconds of real-time image capture step 502.

In step 516, processor 230 may determine whether any input from customer120 has been received while displaying AR graphics. Customer device 110may receive input via I/O devices 220, and/or through display 210 whencustomer device 110 includes a touchscreen. Input may include aselection of one or more icons displayed on display 210 and included inthe AR graphics. In some embodiments, processor 230 may detect an inputwhen customer 120 touches a part of card image 132 or AR graphic, orwhen customer 120 manipulates I/O devices 220 to select a part of cardimage 132 or AR graphic.

If processor 230 detects an input (“Yes” in step 516), in step 518,processor 230 may determine an appropriate response to the detectedinput. For example, when processor 230 detects a selection of a graphicor portion or card image 132 corresponding to a card code verification(CCV) number on account card 130, processor 230 may query FSP server 152and/or data 260 for information related to the query such as, forexample, a card term description, a tutorial video, a tutorialanimation, or one or more images. Once processor 230 determines anappropriate response to the query, processor 230 may generate augmentedreality graphics related to the query and the determined response(returning to step 512). For example, processor 230 cause display 210 todisplay further information regarding CCV numbers, such as when, how,and why they are used, etc. Repeating step 514, the newly-generatedaugmented reality graphics responding to the query may be displayed withcard image 132 on display 210.

In some embodiments, the received input may be related to one or morepreferences for account card 130 and/or the account associated withaccount card 130. For example, customer device 110 may display one ormore augmented reality graphics prompting customer 120 to input one ormore setting selections for account card 130, FSP app 252, or an FSP 150account associated with account card 130. In some embodiments, settingsmay include, for example, spending alerts, payment due date alerts,remaining credit or balance alerts, spending limits, transaction amountlimits, payment account options, or payment dates. Customer device 110may transmit received settings input to FSP server 152 and/or update FSPapp 252 with the received settings input.

In some embodiments, received input may be related to associatingaccount card 130 to FSP app 252 and/or customer device 110. For example,processor 230 may receive an input from customer 120 requesting thataccount card 130 be associated with FSP app 252 and/or customer device110, allowing FSP app 252 to, for example, require fewer securityprotocols become followed before displaying account informationassociated with account card 130 and performing functions related tomanaging account card 130 such as, for example, viewing statements,viewing rewards statuses, paying balances, reporting impropertransactions to FSP 150, and other functions related to card managementbased on the needs of customer 120 and FSP 150. By incorporating one ormore steps necessary to associate account card 130 with FSP app 252during tutorial and preferences setup process 420, customer 120 canimmediately enjoy the benefits provided by FSP app 252, without the needfor performing additional configuration and setup steps at a later time.Thus, the disclosed embodiments provide a single convenient andinteractive experience during which a new card can be activated,configured, and linked to a companion application such as FSP app 252.Furthermore, the disclosed embodiments encourage customers to downloadand install the companion application upon receiving the card, ensuringthat more customers benefit from the enhanced experience provided by thecompanion application.

Returning to step 516, if processor 230 does not detect input for apredetermined amount of time (“No” in step 516), in step 520 processor230 may determine whether tutorial and setup process 420 is complete.Process 420 may complete once all required augmented reality graphicshave been displayed and all required inputs have been received. In someembodiments, FSP 252 and/or FSP server 152 may store a script of therequired augmented reality graphics and required inputs required tocomplete tutorial and setup process 420. If processor 230 determinesthat tutorial and setup process 420 is complete (“Yes” in step 520),then process 400 (referring to FIG. 4 ) may proceed to step 422.

Returning to step 516, if processor 230 determines that tutorial andsetup process 420 is not complete (“No” in step 520), then process 420may return to step 512 in which processor 230 generates new, modified,and/or the same augmented reality graphics. Processor 230 may determinethat tutorial and setup process 420 is not complete when, for example,required AR graphics have yet to be displayed, or additional inputs fromcustomer 120 are required.

FIGS. 6A and 6B are illustrations of an exemplary augmented realty cardactivation process consistent with disclosed embodiments. Turning toFIG. 6A, customer device 110 may display welcome screen 610 in FSP app252, which may provide a brief explanation of the augmented reality cardactivation process, and include one or more buttons for allowingcustomer 120 to login to their FSP 150 account, or scan their newaccount card 130 for activation. If customer 120 selects a button forscanning a new card in scenario 620, customer 120 may begin capturing areal time image of account card 130 using camera 280 of customer device110. During the capture process, customer device 110 may display a cardcapture screen 622 showing a real-time card image 132 of account card130. Customer device 110 may process card image 132 to extract one ormore pieces of card information. Customer device 110 may transmit theextracted card information and one or more customer 120 credentials toone or more computers operated by FSP 150, such as FSP server 152, instep 630. FSP server 152 (via, e.g., processor 320) may query database370 in step 640 to determine whether the received account card 130information and/or customer 120 credentials match information for one ormore FSP 150 accounts stored in database 370. Server 152 may alsoreceive an indication of whether database 370 contains a matchsufficient to activate account card 130 and authenticate customer 120.FSP server 152 may transmit an authentication and/or activationindication to customer device 110 in step 650. In scenario 660, customerdevice 110 may receive the indication from FSP server 152. In someembodiments, customer device 110 may provide an indication ofauthentication and activation immediately on display 210. In someembodiments, customer device 110 may store the account card 130activation indication for later use, and only display the authenticationindication at this stage in the process. As shown in scenario 660, thesteps and processes discussed herein may occur while customer 120 iscontinuing to capture real-time images of account card 130 usingcustomer device 110.

Proceeding now to A, and referring now to FIG. 6B, in scenario 670customer device 110 may launch the tutorial and preferences setup, bydisplaying augmented reality graphics in conjunction with real-time cardimage 132 on display 210 of customer device 110. As shown, customer 120may continue to capture real-time images of account card 130 usingcustomer device 110. Customer device 110 may display augmented realitygraphics in conjunction with card image 132 as illustrated in theexample shown in a first interface 680 and a second interface 690.

In first interface 680, customer device 110 may display card image 132,that is an image of account card 130 displayed in real-time as camera280 is capturing the image. Processor 230 may generate one or moreaugmented reality graphics based on analysis of card image 132. Forexample, augmented reality graphics may vary based on account card 130'sposition on display 210, account card 130's orientation, and cardinformation extracted from card image 132. Augmented reality graphicsmay include information about card terms for account card 130, such asan Annual Percentage Rate graphic 682.

Augmented reality graphics may include one or more graphics that promptor invite input from customer 120. For example, an icon such as questionmark icon 684 may appear next to displayed card terms, or next to partsof card image 132, inviting customer 120 input to learn more about thatcard term or part of account card 130.

Augmented reality graphics may appear relative to the position of cardimage 132, and may include arrows, symbols, or other notation thatappear to “interact” with parts of card image 132. For example,augmented reality graphics may include arrows extending from a card termgraphic to a particular part of card image 132, or to an edge of cardimage 132. Furthermore, augmented reality graphics may include one ormore dashed-line boxes, solid line boxes, underling, or otheremphasizing notation, to highlight a particular portion of card image132. As an example, box 686 may appear on card image 132, with aquestion mark icon or with a card term description, to either promptcustomer 120 to request more information about the highlighted portionor proactively provide information about the highlighted card term. Inthe illustrated example, box 686 surrounds account card 130's expirationdate, and a question mark icon appears next to box 686 to allow customer120 to learn more about account card 130's expiration date.

As discussed above, augmented reality graphics may change continuouslyin response to a continuous analysis of real-time images captured bycamera 280. Second interface 690 illustrates an example of how augmentedreality graphics may change. In the example, account card 130 is flippedto its reverse side, presumably by customer 120 holding account card130. Upon detecting the new real-time image data, processor 230 maychange the augmented reality graphics to correspond to account card130's position, orientation, and content. In second interface 690,augmented reality graphics no longer include card terms and graphicsrelated to card information from account card 130's front face. Instead,augmented reality graphics are displayed corresponding to the reverseside of account card 130. In the illustrated example, augmented realitygraphics remind customer 120 to sign account card 130 by outlining thesignature box, and displaying a message with an arrow pointing to thesignature box. Augmented reality graphics may also outline FSP 150contact information such as a phone number printed on account card 130,and inform customer 120 of when they may contact FSP 150.

Notably, account card 130 is in a rotated position in second interface690, and is not perpendicular to display 210. As discussed earlier,augmented reality graphics may vary depending on account card 130'sposition and orientation. In the illustrated example, emphasis graphicssuch as dashed boxes, and arrows pointing to card image 132 are angledand positioned in a manner that corresponds to the position andorientation of account card 130 in card image 132.

FIGS. 6A and 6B are not meant to limit embodiments of the presentdisclosure in any way, and those of ordinary skill in the art willrealize that customer device 110 may generate and display differentaugmented reality graphics depending on the needs of FSP 150 andcustomer 120.

Those skilled in the relevant arts would recognize that the augmentedreality activation methods and systems described herein could be usedfor purposes other than activating a credit card. For example, theaugmented reality methods could be used to guide customers through theparts and terms of their account statement or bill.

The foregoing description has been presented for purposes ofillustration. It is not exhaustive and is not limited to the preciseforms or embodiments disclosed. Modifications and adaptations of theembodiments will be apparent from consideration of the specification andpractice of the disclosed embodiments. For example, the describedimplementations include hardware and software, but systems and methodsconsistent with the present disclosure can be implemented as hardwarealone.

Computer programs based on the written description and methods of thisspecification are within the skill of a software developer. The variousprograms or program modules can be created using a variety ofprogramming techniques. For example, program sections or program modulescan be designed in or by means of Java, C, C++, assembly language, orany such programming languages. One or more of such software sections ormodules can be integrated into a computer system, non-transitorycomputer-readable media, or existing communications software.

Moreover, while illustrative embodiments have been described herein, thescope includes any and all embodiments having equivalent elements,modifications, omissions, combinations (e.g., of aspects across variousembodiments), adaptations or alterations based on the presentdisclosure. The elements in the claims are to be interpreted broadlybased on the language employed in the claims and not limited to examplesdescribed in the present specification or during the prosecution of theapplication, which examples are to be construed as non-exclusive.Further, the steps of the disclosed methods can be modified in anymanner, including by reordering steps or inserting or deleting steps. Itis intended, therefore, that the specification and examples beconsidered as exemplary only, with a true scope and spirit beingindicated by the following claims and their full scope of equivalents.

What is claimed is:
 1. A method, comprising: capturing, by a camera, animage of an object associated with an account; processing, by one ormore processors in communication with the camera, the image to obtainfirst information associated with the account; generating a firstgraphic based on the image, the first graphic including secondinformation about the object that is not presented on the object;displaying a second graphic comprising the first graphic configured toobtain user input, the second graphic comprising an object activationquery overlaid on the image; detecting a change to a position or anorientation of the object; modifying the second graphic based on thechange; receiving the user input comprising a response to the objectactivation query; and transmitting, to a server, an activation requestcomprising information relating to the user input.
 2. The method ofclaim 1, wherein the change to the position or the orientation of theobject is in response to not being able to detect the object.
 3. Themethod of claim 1, wherein the second graphic is associated with atutorial for facilitating an activation and includes one or more of:features associated with the object, preferences associated with theobject, and informative data associated with the object.
 4. The methodof claim 3, further determining whether the tutorial is complete bydetermining whether all required inputs have been received.
 5. Themethod of claim 1, wherein the second graphic includes at least one of atext field, an image field, or a video explaining financial servicesassociated with the object to a user of the object.
 6. The method ofclaim 1, wherein modifying the second graphic further comprises at leastone of resizing the second graphic, relocating the second graphic,rotating the second graphic, or changing content of the second graphic.7. The method of claim 1, wherein detecting the change to the positionor the orientation of the object further comprises: detecting the objectfor a predetermined time period and when no object is detected,prompting a user to reposition the object; and extracting objectinformation from the object when the object is detected.
 8. A system,comprising: one or more processors; and one or more memory devicesstoring instructions that, when executed by the one or more processors,performs operations including: capturing, by a camera, an image of anobject associated with an account; processing, by the one or moreprocessors in communication with the camera, the image to obtain firstinformation associated with the account; generating a graphic based onthe image, the graphic including second information about the objectthat is not presented on the object; generating for display the graphicconfigured to obtain user input, the graphic comprising an objectactivation query overlaid on the image; detecting a change to a positionor an orientation of the object; modifying the graphic based on thechange; receiving the user input comprising a response to the objectactivation query; and transmitting, to a server, an activation requestcomprising information relating to the user input.
 9. The system ofclaim 8, wherein the change to the position or the orientation of theobject is in response to not being able to detect the object.
 10. Thesystem of claim 8, wherein the graphic is associated with a tutorial forfacilitating an activation and includes one or more of: featuresassociated with the object, preferences associated with the object, andinformative data associated with the object.
 11. The system of claim 10,further determining whether the tutorial is complete by determiningwhether all required inputs have been received.
 12. The system of claim8, wherein the graphic includes at least one of a text field, an imagefield, or a video explaining financial services associated with theobject to a user of the object.
 13. The system of claim 8, whereinmodifying the graphic further comprises at least one of resizing thegraphic, relocating the graphic, rotating the graphic, or changingcontent of the graphic.
 14. The system of claim 8, wherein detecting thechange to the position or the orientation of the object furthercomprises: detecting the object for a predetermined time period and whenno object is detected, prompting a user to reposition the object; andwhen the object is detected, extracting object information from theobject.
 15. One or more non-transitory computer readable media, storingsoftware instructions that, when executed by one or more processors,cause the one or more processors to perform operations comprising:capturing, by a camera, an image of an object associated with anaccount; processing, by the one or more processors in communication withthe camera, the image to obtain first information associated with theaccount; generating, a graphic based on the image, the graphic includingsecond information about the object that is not presented on the object;displaying, on a display in communication with the one or moreprocessors, the graphic configured to obtain user input, the graphiccomprising an object activation query overlaid on the image; detecting achange to a position or an orientation of the object; modifying thegraphic based on the change; receiving the user input comprising aresponse to the object activation query; and transmitting, to a server,an activation request comprising information relating to the user input.16. The one or more non-transitory computer readable media of claim 15,wherein the change to the position or the orientation of the object isin response to not being able to detect the object.
 17. The one or morenon-transitory computer readable media of claim 15, wherein the graphicis associated with a tutorial for facilitating an activation andincludes one or more of: features associated with the object,preferences associated with the object, and informative data associatedwith the object.
 18. The one or more non-transitory computer readablemedia of claim 17, further determining whether the tutorial is completeby determining whether all required inputs have been received.
 19. Theone or more non-transitory computer readable media of claim 15, whereinthe graphic includes at least one of a text field, an image field, or avideo explaining financial services associated with the object to a userof the object.
 20. The one or more non-transitory computer readablemedia of claim 15, wherein modifying the graphic further comprises atleast one of resizing the graphic, relocating the graphic, rotating thegraphic, or changing content of the graphic.